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fhe purpose of this project was te present a test precedure with 
methods and techniques for eveluation of accuracies ebtainad in « 
simultaneous adjustment of data from wore than one photographic satellite 
mission. The requirement for a Test and Evaluation Plan became evident 
when it was deteruined that 2 couplete void existed in the area of testing 
the resulte froe a simultaneous, milti-miseion adjustumst ef all BAIT 
uissioas. While this plan is presently directed toward the abitiple 
orbit adjustweat of the existing BAY? photography, it is designed to be 
sufficiently general to be applied te any photogrammatric adjustaent 
employing orbital constraints. The approach ceployed censists ef a 
series of discrete phases. The first step concems the generation 
of an ephermeris from a reduction of the materials. Through an analyses 
of the residuals generated on mission data, systematic errere can be 
recognized end removed. After the systemstic errors have been reselved, 
the adjusted exposure station data will be used te compute the positions 
of known geodetic control] points with associated errer prepagation. parameters. 
The evaluation of the predicted errors in couparison with the known true 
positional error represents the final phase ef the teating effort. 
The author has arranged the report to highlight the setual astheds and 
techniques for the testing end evaluation outlined in Section 27%, 
Test Precedures. In recognition of the iupertance of the statistical 
nature of the plan, sll] etteupts have been made te establieh a mathout ical 
and philosophical ground werk for the final description ef the plan. The 
discussion presented on the accuracy and precision significance of the adjustment 
problea is both comprehensive and pertinent to the problem at head. In 
recognition of the peeuliarities of the multi-sission reductions of DAI? 
missions, eany expansive and time cooguaing statistical teste for the 
goodness of fit of residuals could be performed. The Students "ce" 
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| The purpose of this project was te present e test precedure with 

methods and techniques for evaluation of aceuracion obtained in «a 

| eimiltanecua adjustaant of data from more than cme photographic satellite 

| mission. The reqvireasnt for a Test and Evalyation Plen became evident 

| wien 16 wae doteraian® thst complete vets exstet tn ene aren oF teeting 

| the results from « simultaneous, mlti-sission adjustumat ef all DAPF 

uissions. While this plan is presently directed toward the abltiple 

| orbit adjustuant ef the existing DAFF photegrephy, it is designed to be 

| eufficiently general te be applied te any photogrammetric adjustuent 

| employing orbital constraiate. The approseh euployed ceasiats of a 
series of discrete phases. The first step concems the generation 

| of an ephermeris from a reduction of the aterfals. Through an analyses 

; of the residuals generated on mission data, systematic arrers can be 

| recognized and removed. After the systematic errers have been reselved, 

| the adjusted exposure station data will be used te compute the positions 

of known geodetic control points with asecciated errer prepegation. parensters. 

| The evaluation of the predicted errors in comparison with the known true 

| positional error represents the finel phase of the testing offert. 

| The author hae arranged the repert to highlight the astusl sstheds ané 

techniques for the testing and evaluation eutlined in Section 272, 

Test Precedures. In recognition of the ‘aportance of the statistical 

| nature of the plan, si] attespts have been made te establish a msthemtiesl 

| and philosephical ground werk for the final description ef the plen. The | 
discussion presented ou the securacy and precision significance ef the adjustumt 

| problem is both cosprehensive and pertinent to the problem at hend. In 

| recognition of the peculiarities of the multi-atssion reductions of DAFF 
missions, miny expansive and time consuaing statistical tests fer rhe 
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significance test for mean and F-ratio significance test for weriance 


are sufficiently elegent to meet a1] demands for error analysis and do 

not place a tremendous computational burden on the user, The aspects of 
these twe tests that beve led the Contracter to this choice concern the 
“safety factors" built into the tests used and the fact that the tests 

can be used with confidence ewen if the distributions are non-nerual. 

In addition to a statistical discussion, the contents of Appendix 3 

help to represent the supporting mathematics - equations and fermilae - 
necessary ie « couplete set-up of the testing and evaluation progres. 

The description of the actual test procedures used in assessing the 
accuracies obtainable from s simsltaneeca milti-sission adjustment is 

in sufficient detail te be tumediately applied te the BAFF data reductions 
and general ensugh te be applied te future analyses. The test is aimed 

at determining the acouracy of a point en the greund that was positioned 
by photograometric intersection fram two or mere exposure stations whoes 
positions have been ebteined from the orbit adjustment. A brief 

emphasis is made by the Contrector concerning the preblens of comparative 
evaluations of milti-mission reductions utilising RECAP and TRACE, The 
difficulties of euch comparative enalyees become imugdiately epparent 
even with the few comments made by the author. In order that systematic 
errors be detected, the observation reeiduale ere divided into subsets 
besed on some physical characteristie aad then a couparison is made of 

the mean and variance of each eubeet to an equivalent statistic fer the 
full set of residuals. The residuals for range, tracking caueras, 

control points, and rolative gecuetry peints are generated, collec 
separately, and then the two statistical rests ~ Student's "t" and “F-ratio" - 
applied. A tabuler display (an exeeple is contained in Appendix A ef 
report) represents the failvre, magnitude and frequency for a part icelar 
characteristic residual and peraits furthex analysts fee systeustic errer 
identification and subsequent re-adjustment, These systenetic errece, 

of course, can be aission dependent, datum dependent, trecking instrumentation 
dependent or a combination of dependent errers. ‘The Contracter was not 

to provide a means fer identifying the characteristic ef every posdbie 
error source epen in a particular residual analyses. The author has, 
however, provided the guidelines needed for meking a logical deduction 

of a particular syetematic error. Although the user 1s eutrenely 

capable in the teehnolegieal area of the processing, transfer, end 
measuration of photogrammatrie data, the Contracter has outlined presedures 
for these particular items to insure thet such procedures are standardized 
fer the test. Computation ef che eheck peiat pesitiens ead propagation of 
@rrors through the associated veriance - covarience watriz provides the 
data needed for subsequent aceumey analysis atatements. A check ef euch 
position statements against the knawn tims check point pesiticens will | 
provide the needed informtion to determine vhather oc wot ell syatemetic 
errors in exposure station positions have been reduced balew « ranéen 
error seise level. The sasple of the computed check point positions fall 
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withia « particular probebility ellipiseid (a 90% prebebility ellipisoid 


was choses by the Contractor) then the coordinates of any unknown points 
can be computed and with a high degree ef confidence. Ina other werds, 
all the systemetic errors have been eliminated anf a true accurecy 
statement fer this peint is available, which of gourse is the whole 
purpose for the generation of the Test and Evaluation Plan. Nothing in 
this plan reflects en origina] mathematical formation te solve this 
problem. The plan does, however, represent a refreshing approach to « 
serious problem which has been neglected for tee leng. 


The Test and Evalustion Plan contained in the final report represents 
en excellent vehicle for anelyzing the simultaneous aultiple-nission 
adjustments ef the DAFF aissions and any future reductions. This gesrsl 
eritique statement includes each and every agpect of the report. Although 
specific formilations, tables, exmuples, and descriptions vere wade by 
the author, the plan is really designed to place flexible guidelines as 
to che final eveluationse, metheds, end techniques and enables the user 
to bring to bear on the problem of DAFF eisasion analyses, the meximum 
in-house talente end experience. Notations on spectfie items should be 
made. The statistical tests suggested by the Contractor will surely 
be adequate for evaluation for geodneas of fit and overall systeustic 
error elimination. Since these testa are probably a little different 
than those normilly used, it is worth neting thet particular advantage 
realised in thie problea of multi-nission reductions. The ain point. 
is that a high confidence in results of the analyses is pessible even if 
the data tested is a possible nen-noraa] distribution. The prebdlen of 
comparing RECAP and TRACE reductions {s important to the famediate enalysas 
of DAFF uissions and it had been hoped that the plan would include tna a 
more definitive fashion a procedure to perform this comparison, Mowever, 
in noting the extreme complexity ef such enalyses, the plan provided will 
represent the departure poiat for comparative analyses and this deficiency 
is not in any way seriously detrimental te the coutent end ult imate 
purpose of the plan. The report did not cover every pessibility that may 
be encountered in systematic error defimitions. The very seepe of the 
problem is much toe difficult to adequately present fn this repect 
because of the severe couplexity of the analyses. Those items listed in 
the treataent of a paramster dependent systemstie errore are more than 
adequate for the needed errer analyses. The sequence of the trestuant 
for errors are such that the elimination of the pessible lerger sources 
are considered first and subsequent error scurces syatematically eliminated. 
The sections covering the actual BAFF-type data used and che 
euployed ia reductions analysea previde the needed guidslinss fer a planned, 
deliberate, and consistent appreach to the problem. An excellent vehicle 
for arriving at an accuracy evaluation for a mission or particular portion 
of a mission is present in the comparative checks between computed positions 
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end accuracies and known values for the sams points. Thies repert 
represents « moet Significent tool fers evaluation of DAFF and other 
uissions and has been needed for tan leng. ‘The eurrent status ef the 
reductions of AMB indicates that the availability of a Test and 
Evaluation Plan at this tice is not only opportune, but necessary. 

The Gentractor's eonclusions are anti-climstie im light ef the excellent 
presentation. The reccmmmdations are equally well-founded and they follow 
logieally from the body of the report. An investigation ef the ultimte 
accuracies of existing msterial with additional analyses of future inputs 
of other control may, as etated, enable a significant by-product to be 
produced - a plan for eontrol enhancement to be formulated froa 
conclusions ef the study and analyses. 


The Test and Evaluation Plan presented in the report is exellent 
in content and in presentation. It is recommended that this report be 
accepted. Also it is recomended that efforte be initiated to put the 
recounsnidations mide by the Contracter in:o a definitive study plan. 
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